On the Continuous Diffusion Approximation of Some Discrete Markov Chains
نویسنده
چکیده
The diffusion approximation of some Markov chains with Binomial-like transition probabilities is considered and their qualitative behavior is analyzed. The stationary distribution, attainability of boundary and estimation of parameters are investigated. Some examples are reported.
منابع مشابه
Continuous approximation of collective system behaviour: A tutorial
In this paper we present an overview of the field of deterministic approximation of Markov processes, both in discrete and continuous time. We will discuss mean field approximation of discrete time Markov chains and fluid approximation of continuous time Markov chains, considering the cases in which the deterministic limit process lives in continuous time or discrete time. We also consider some...
متن کاملApproximate analysis of biological systems by hybrid switching jump diffusion
In this paper we consider large state space continuous time Markov chains arising in the field of systems biology. For a class of such models, namely, for density dependent families of Markov chains that model the interaction of large groups of identical objects, Kurtz has proposed two kinds of approximations. One is based on ordinary differential equations and provides a deterministic approxim...
متن کاملConvergence Rates of Markov Chain Approximation Methods for Controlled Regime-Switching Diffusions with Stopping
This work summarizes our recent work on rates of convergence of Markov chain approximation methods for controlled switching diffusions, in which both continuous dynamics and discrete events coexist. The discrete events are formulated by continuous-time Markov chains to delineate random environment and other random factors that cannot be represented by diffusion processes. The cost function is o...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملBackward and Forward equations for Diffusion processes
This section is devoted to the discussion of two fundamental (partial) differential equations, that arise in the context of Markov diffusion processes. After giving a brief introduction of continuous-time continuous state Markov processes, we introduce the forward and backward equation, and provide a heuristic derivation of these equations for diffusion processes. We also discuss some examples ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009